Higher Order Visibly Pushdown Languages 


A Thesis Submitted 

in Partial Fulfillment of the Requirements 
for the Degree of 

Master of Technology 


by 

Shaji Illias C K 



Department of Computer Science k Engineering 

Indian Institute of Technology, Kanpur 


June, 2005 




TT ‘fin 

fwUi*r 

wrarte sTt^ftPr^ ww 

wfe w» A..X^.lSiiZ.. M .» 



Certificate 


This is to certify that the work contained in the thesis entitled “ Higher Order 
Visibly Pushdown Languages ”, by Shaji Illias C I \ , has been carried out under my 
supervision and that this work has not been submitted elsewhere for a degree. 


June, 2005 


(Dr.Anil Seth) 

Department of Computer Science & Engineering, 
Indian Institute of Technology, 

Kanpur. 



Abstract 


Visibly pushdown automata (VPA) has been recently defined as a restricted ver- 
sion of pushdown automata. It has been shown that the class of languages recognized 
by them (VPLs) are closed under all the boolean operations and have tractable de- 
cision problems. 

We introduce a new variation of higher pushdown automata named “higher order 
visibly pushdown automata” (HVPAs) as an extension to VPAs and the class of 
languages accepted by them (HVPLs) is studied. In the higher order pushdown 
automata the symbols appearing on pushdown stacks are no longer ordinary symbols 
but stacks themselves. Wo show that the set of languages accepted by this model is 
closed under union, intersection, renaming operation etc. We also prove that HVPLs 
are not closed under determinization, concatenation and Kleene * by giving counter 
examples. 

We also look at the omega language accepted by HVPAs (a;- HVPLs) and shows 
that co-HVPAs with Buchi and Muller acceptance conditions are equivalent. 
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Chapter 1 
Introduction 


Recently in [l] the class of visibly pushdown languages (VPLs) has been defined as 
a subclass of context free languages. It has been shown that VPLs are closed under 
all boolean operations and determinizable (and hence closed under complementation 
). And decision problems viz emptiness, inclusion and universality are shown to be 
decidable. In VPLs the input alphabet is partitioned into three sets namely call, 
return and internal symbols. The operation on the stack is determined by the type of 
the alphabet read by the automata. More precisely a push (pop) operation is always 
performed when an alphabet of type call (return) is read. When the automaton 
reads an internal symbol it can change only its state by leaving the stack contents 
unaltered. 

VPLs are relevant to several applications that use context free languages such as 
model checking of software programs and their pushdown models. In [3], Pitcher 
suggests VPLs to be the best model for semantics of effects in processing XML 
streams. Games on visibly pushdown systems are also been defined and its topolog- 
ical complexity is studied in [4] and [5]. 

Higher order pushdown automata (HPDA) was first considered by Aho and Ull- 
man in [6]. They showed that 2-level pushdown automata recognize the indexed 
languages. In [7] and [8] Maslove shows that k-level pushdown automata correspond 
to k-level indexed grammars. In [9] Damm and Geordt gives a characterization of 
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k-level pushdown automata in terms of k-level OI-indexed grammars. In general, 
the hierarchy of languages accepted by different level higher order pushdown au- 
tomata are viewed as an infinite Chomsky hierarchy, called OI-hierarchy with finite 
automaton at the Oth level, context free languages on the first level and so on. 

In higher order pushdown automata the symbols appearing on pushdown stacks 
are no longer ordinary symbols but stacks themselves. These kind of stacks are 
called higher order stores. Stores of level- 1 axe sequences of symbols from some 
finite set of alphabets. In fact level-1 pushdown store is the ordinary stack. Stores 
of level-n are sequences of level-(n-l) stores. The allowed operations on this store 
are, 


1. ordinary push and pop operations on top level- 1 stack 

2. k-order push and pop operations allowing to duplicate or erase the top-most 
level level-k store of any given level k <n. 

j 

It was always been a matter of interest to look at some restricted model of HP- 
DAs which have more closure properties than ordinary HPDAs have. Here we are 
introducing a restricted version of HPDAs named “higher order visibly pushdown 
automata” (HVPA) and the language accepted by it (HVPL) is studied. Similar to 
VPAs in the case of HPVAs also we partition the input alphabets into three classes 
namely call, return and internal. For an n-level HVPA the call and return sets are 
further partitioned to n sets say call\,. . .call n and return ^. . . retum n . While read- 
ing the input alphabet, the behavior ( push and pop ) of automata is decided by in 
which partition the input alphabet read belongs, i.e, for alphabets in the same class 
the stack of automata behaves in the same manner. When the automaton reads a 
calli ( rcturrii ) symbol then it performs a pushi{popi ) operation. When it reads an 
internal symbol, as in case VPAs it changes the state and leaves the stack unaltered. 
This restriction makes it easier to prove some of the closure properties. 
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In this work we prove that HVPLs are closed under union, intersection, renaming 
operation etc. We also prove that HVPLs are not closed under determinization, 
concatenation and Kleene * by giving counter examples. 


We also look at the omega language accepted by HVPAs and shows that the Buchi 
and Muller acceptance conditions are equivalent. Further we show that, cj-HVPL. 
are not determinizable. 
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Chapter 2 
Definitions 


2.1 Visibly Pushdown Automata(VPA) 

A pushdown alphabet is a tuple £ = (£ c , £ r ,£j nt ) that comprises three disjoint 
finite alphabets- £ c is a finite set of calls, £ r is a finite set of returns and T, int is a 
finite set of internal actions. For any such £, let £ = E c U E r U E irU 

We define pushdown automata over E. Intuitively, the pushdown automaton is 
restricted such that it pushes into the stack only when it reads a call, it pops the 
stack only at returns, and does not use the stack when it reads internal actions 
symbols. The input hence controls the kind of operations permissible on the stack 
- however there is no restriction on the symbols that can be pushed or popped. We 
call such an automaton a visibly pushdown automaton, defined as follows: 

Definition (Visibly Pushdown Automata) A visibly pushdown automaton on 
finite words over (£<., E r , £ int ) is a tuple M = ( Q , Q in , T,5,Qp) where Q is a finite 
set of states , Q in C Q is a set of initial symbols, T is a finite set of stack alphabets 
that contains a special bottom- of- stack symbol JL (a symbol which is never popped), 
5 C (Q x E c x F x Q x (r \ {J_})) U (Q x £ r x F x Q) U (Q x £ int xTxQ), and 
Qf C Q is a set of final states. 
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A transition (q,a,'y , ) q’ ) 7) where a G E c and 7 ^ JL, is a push-transition where on 
reading a, 7 is pushed onto the stack and the control changes from state q to q’. 
Similarly (q,a,~i,q’) is a pop-transition where 7 (7 7^ J_) is read from the top of the 
stack and popped, and the control state changes from q to q\ If the top symbol on 
stack is _L, machine does not pop it, it just changes the control state from q to q\ 
Note that on internal actions there is no stack operation. 

A stack is a nonempty finite sequence of over F ending in the bottom-of-stack 
symbol J_; let us denote the set of all stacks as St = (T \ {_L})*.{JL}. For a word 
w = a\ . . . ak in E*, a run of M on w is a sequence p = (go, cr 0 ), . . . , (g*, 0*), where 
qi G Q, Oi G St , qo G Qi n , cr 0 = ± and for every i G [l , k] the following holds: 

[Push] If a,i is a call, then € T such that ( g 4 , a,, 7', q i+ 1,^) € 6 and a i+ 1 = 7.0*. 

[Pop] If a,i is a return, then 87 € T such that (q i; a,, 7, q i+ i) € 6 and either 7 7^ _L 
and <Ji = 7.a i+ i., or 7 = _L and = a i+ 1 = ±. 


[Internal] If a* is an internal action, then (g i; a,, 7, g i+ i) G (5 and a i+ i = cr,. 

A run p — (qo,vo), • • • , (qk,&k) is accepting if the last state is a final state, i.e if 
qk € Qf- A word a; G E* is accepted by a VPA M if there is an accepting run of 
M on w. The language L of M, is the set of words accepted by M and a language 
is said to be visibly pushdown language (VPL) if there is some VPA to accept it. 

2.2 Higher Order Pushdown Automata(HPDA) 

We define level n store(stack) in a recursive manner. A level 1 store { or 1 -store) 
over a finite set of stack alphabet F is an arbitrary sequence of [71, ... , 7;] of F with 
l > 0 . A level n store or n-store, for n > 2 , is a sequence [si, . . . , s/] of (n- 1 ) stores 
where l > 0. Let Q be the set of states of the PDA and E be the set of input 
alphabets. Then following operations can be performed on 1 - store-, for 7 G T, a G E 
and qi , (jj G Q 
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push}(q u a, 7i,[7i,---,»7/-i,7i]) ••=(%■, [7 i,-..,7/-i,7/,7]) 
PPPi(g<,a,7/,[7i.-*-.»'n-i,'>l]) : = (?j.[7ii • • • > 1 7i-i] ) 

If [si, . - . , Si-i, si] is a store of level n > 1 and let 7 be the stack top of topmost- 
1 -store of si, then the following operations are possible: 
push n (? i ,a, 7 ,[si,...,s 1 _ 1 ,si]) := (ft,[si, . . . , Si_i, s h 5/]) 
push k (qi,a,y,[si, . . . , S1-1, si}) := (qj,[s u . . . ,si-i,push k (si)}) if 2 < k < n 
push] (ft, a, 7 , [si, . . . , s/_i,Si]) := (g i ,[si,...,s f _ 1 ,pus/i 7 (ft)]) 

POPn (?i) ^i7t[^l 5 • • ■ 1 X t ^(]) • (9j)[ 5 li • • • > s /-l]) 

ppp fc (ft,a, 7 ,[si,...,si_i,si]) := (qj,[si,. . . ,Si-i,pop*(si)]) if 1 < k < n 


Note that level 1 operations are ordinary push and pop operations. 

Given T, E and n, the set Op n of operations (on a store) of level n consists of : 
push k for 2 < k < n, push} for 7 G T, and pop k for 1 < k < n. 

Definition (Higher order Pushdown automata) A higher order Pushdown 
automata of level n (or n-HPDA) over a finite set of input alphabets £ is a tuple 
M — (Q,Qin,T,5,QF) where Q is a finite set of states, Q in C Q is a set of initial 
states, Qp C Q is a set of final states, T is a finite set of stack alphabets and 
SC(Qx'£xTxQx Op n ) is the transition function. 

In our definition of HPDA we do not allow any e-moves. 

/ 

Language of an HPDA is defined in a common way. Set of languages accepted by 
level n HPDA is called level n languages. 

2.3 Higher Order Visibly Pushdown Automata(HVPA 

In this section we introduce a new model of computational called Higher Order 
Visibly Pushdown Automata (HVPA). Basically it is a VPA with an iterated stack 
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[level n-stote). As in the case of ordinary VPA, the kind of operations per mi ssible 
on the stack of HVPA is controlled by the input symbol read. 

Let £ = <£ c ,£ nEj „t) be a set of pushdown alphabet. Here we have a partition 
on both E c and E r . i.e £< ; = E Cl U . . . U £ Cn and E c .’s are pairwise disjoint (i.e 
£ c , H E Cj = 4> for i 7 ^ j)- Similarly E r = E Tl U . . . U £ rn and E rj ’s are pairwise 
disjoint (i.e £ r , nE rj = <fi for i ^ j). The partition on £ c (S r ) determines which order 
push(pop) operation is performed by the machine. That is, if the machine reads a 
symbol in £ Ci (£ r J, a Pushj [Popi) is performed on the stack. One interesting 
thing to notice is that, non-determinism does not have much role to play when we 
perform a Pus hi or Pop x for i > 1 , because the stack would be exactly the same 
in every possible moves. So when the machine reads an alphabet which belongs to 
£ c , (E r| ) for i > 1 , iron-determinism is restricted to making choice among various 
possible states only. 

Assumptions about the model: When we start the computation, we assume 
that we have an empty n store with the special bottom-of-stack symbol JL on its 
1 -store. As in case of VPAs we make sure that _L symbol is never popped. Also 
e-moves are not allowed in HVPAs so that the machine is forced to read an input 
symbol in every move. 

Another assumption we make is that, the machine does not pop the last ( i-1 )- 
store from an i- store. Instead of that the machine signals that the store we are 
trying to pop is the last store in the immediately enclosing store. Depending on 
this information the machine can decide to which state it should move. In a way 
this is a natural extension of the assumption that _L is never popped from a 1 -store. 
In order to make this invariant possible, we assume that the machine queries every 
time before it makes a transition and the answer is used in making the decision. Let 
o denotes the store of the HVPA, we define a function Is-Last , which takes o and 
the input alphabet currently reading as its parameters. Is -Last is defined as follows 
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Is-Last(cr , a) returns ‘Y’ if a € E r< and the stack going to be popped is the last 
stack in the topmost ( i+l)~store and ‘N’ otherwise. We make this invariant as part 
of the transition relation. Now we define HVPA formally as follows: 

Definition (Higher Order Visibly Pushdown Automata(HVPA) ) A higher 
order (of level n ) VPA on finite words over E = (E c , E r ,Ej nt ) is a tuple M = 
(Q, Qin, r, 8, Qp) where Q is a finite set of states, Q, n C Q is the set of initial 
states, Qs Q Q is the set of final states T is the finite set of stack alphabets that 
contains a special bottom- of- stack symbol ±and 5 is the transition relation. 

The transition relation 5 C (Q x E int x T x Q) U (Q x E Cl xTxQx PushJ ) U 
(Q x E ri x T x Q x Pop\ ) U (Q x E Ci x T x Q x Pushi ) U (Q x E r< x T x l N' x Q x 
Popi) U (Q x E ri x T x i Y' x Q) for 7 € T and 2 < i < n. 

Here ‘Y’ and ‘N’ are the values returned by the IsJLast function when queried 
with the stack and the current input alphabet. Note that the stack of a level n 
HVPA will be a level n store and higher order push and pop operations are possible. 

Behavior of HVPA: The behavior of an HVPA on reading various inputs is given 
as follows: 

[Push] If a G E CJ then we have an ordinary push operation(/ei>el lox Pushi). 

If a € E Ci for 2 < i < n then we have an level i or Pushi push operation. 

[Pop] If a € E n then we have an ordinary pop operation(/enei 1 or Popi). 

If a € E r . for 2 < i < n then we have an level i or Pop, push operation, provided 
IsJLast returned ‘N’. 

[Internal] Internal actions are same as that of VPA. 

Run of HVPA : Let M be a level n HVPA. For a word w = ai . . . af. in E*, a 
run of M on w is a sequence p = (qo,cr 0 ),. .. ,(q k ,a k ), where q { e Q, Oi is level n 
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store (stack) qo G .Qi n , &o = -L and the sequence cr-s are consistent with transition 
relation of HVPA. For example if a* G £ r3 then q i+i G 6(qi, a*) and tr i+1 is obtained 
from <7j by doing a ZeweZ 5 Pop(Pop 3 ) operation and son on. 

A run p = (q 0) cr 0 ), . . . , (<&, at) is accepting if the last state is a final state, i.e if 
Qk € Qf- A word w G £* is accepted by a HVPA M if there is an accepting run 
of M on w. The language of M, is the set of words accepted by M. A language L 
is said to higher order visibly pushdown language (HVPL), if there is some HVPA 
which accepts it and we write L = L(M). 

Definition (Higher Order Visibly Pushdown Languages(HVPLs)) A lan- 
guage of finite words over L C E* is a higher order visibly pushdown language 
(HVPL) if there is a HVPA M over £ such that L(M) = L. 

Note: When we talk of HVPLs one thing to notice is that the partition on the 
input symbols is part of the definition of language itself. So the following two 
languages are different 

Li = {a n 6 n } over E = (E c , E r , £ int ) with E Cl = {a}, E ri = {b} and £ int = 4>. 

L 2 = {a"b n } over E = (£ c , E r , Ej n£ ) with E C2 = {a}, E r2 = {b} and £j n( = <f>. 

2.4 A language accepted by HVPA but not by 
VPA 

Consider the language L-{a n 6c n de n |n > 1} over E = (E c ,E r ,E int ) with E c = 
{a, b}, E r = {c, d, e } and E int = <f>. It is clear that no VPA can accept ( not even by 
PDA ) can accept this language. But we can design a HVPA of level 2 to accept 
this language with £ Cl = (a},E C2 = (6), £ ri = {c,e}, E rs = {d} and E in£ = 


When it reads an a it makes an ordinary Push operation. When it sees b it makes 
a Push 2 operation so that now we have two copies of a n in the stack. The topmost 
copy can be used for matching of c n . When the machine encounters d it pops(Pop 2 ) 
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the top most 1-Store only if it is empty. Now the matching of e n can easily be done 
using the second copy of a n . 

We design an HVPA M - ({go, <?i, 92 , , g a «}, {go}, {A}, 5, {g acc }) to accept L. In 
order to make the machine simpler, we add a marker $ ($E Sint) at the end of the 
input. The transitions of M axe as follows: 

(g 0 , a, _L /A) i-> (g 0 , Pushf) 

(q 0 ,b,A) (qi,Push 2 ) 

(gi ,c,A) i-* (gi, Popi) 

(gi, d, JL, l N') y-r (g 2 , Pop 2 ) 

( 92 , e, A) t-» (q 2 ,Popi) 

(q 2 , $, _L) i— > (g acc ) 

It is easy to see that L(M) = L. 

2.5 Deterministic HVPA 

Definition(Deterministic HVPA) A HVPA M = (Q, Qi n , T, 5, Qp) is said to 
be deterministic if |Qi rl | = 1 and for every g, g' G Qjj'eT: 

• for every a E Si, )t , there is at most one transition of the kind (g,a, 7 , g') E 6 

• for every a E S Cl , there is at most one transition of the kind (g, a, Y, g', Push]) E 
<5 

• for every a E E Cj , i > 1 , there is at most one transition of the kind (g, a, 7 , q', Pushi) E 

5 


• for every o E E n , there is at most one transition of the kind (g, a, 7 , g', Pop\) E 8 

• for every a E E Ti ,i > 1 , there is at most one transition of the kind (g, a, 7 , l N', q', Popi] 
5 
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• for every a € E ri , i > 1 , there is at most one transition of the kind (q, a , 7, ‘Y', qf) € 

8 

2.6 Renaming Operation 

A renaming of £ to if is a function /:£—►£' such that /(Sint) <= £- nt , 
/(£<*) £ £^ and /(E r< ) Q A renaming of / can extended to words over E in 
the natural way : /(a x . . . a k ) = /(ai) . . . f(a k ). 
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Chapter 3 

Closure Properties of HVPLs 


In this section we prove that HVPLs are closed under union, intersection, and 
renaming. We also show that any ordinary HPDL can. be converted to a HVPL under 
a special kind of mapping on the set of input alphabet. We also provide counter 
examples to prove that HVPLs are not closed under determinization, concatenation 
and Kleene *. 

3.1 Closure under union 

Theorem 1 ( Closure under union) Let L x and L 2 be higher order visibly push- 
down languages with respect to E. Then L X \J L 2 is higher order visibly pushdown 
language with respect to E. 

Proof: Let M x = (Q x , Q ini , T Xi 5 x ,Q Fl ) and M 2 = (Q 2 , Qm 2 , T 2 , £ 2 , Qf 2 ) be HVPAs 
which accepts L x and L 2 respectively. Assume that Q x (~l Q 2 = <t>- 

Define M — (Q, Qmi^i Qf) such that Q — Q x U Q 2 j Qm ~ Qm x U Qtn2> Qf = 
Qf\ C Qp 2 > r = Ti U r 2 and 6 — S x U <5 2 . 


Intuitively, M is capable of simulating all runs of both M x and M 2 . M non- 
deterministically selects one of the initial states of M x or M 2 . Suppose the selected 
initial state is that of M x , then M starts to simulate a run of M x on the input string. 
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Since Q x D Q 2 = 4 > there is no fear of mixing up of runs of M x and M2. So if the 
given input string w is in L x UL2, then M has an accepting run on w. That implies 
Li U L 2 C L. 


On the other hand, suppose M has an accepting run on w. Since the transitions 
of M are exactly the union of transitions of M\ and M2, the accepting run of M on 
w is one of the runs of either Mi or M2. So w G L(M) => w G L x U L 2 . 

Therefore L{M) = L(M X ) U L(M 2 ). * 

Alternative proof: To accept L x \JL 2 we design a HVPA M = (Q, Qj n , F, 5, Qf) 

with Q = Q\ X Q 2 i Qin = Qin\ Qin^i Qf = {Ql ^ Q/2} O {Qfi X O2} i f 1 = fl X T 2 - 


Intuitively M is trying to simulates runs of Mi and M 2 in parallel. A run of M 
on the input string is accepting if one of the runs of Mi or M 2 is accepting, i.e if 
M ends up in a state (qi,qj) on an input string w, then w is accepted if € Qf± or 

Qj £ Qf 2 - 


When reading a G £ Cl if M x pushes 71 and M2 pushes 72 the M pushes (71,72). 
One important thing to note is that while reading a symbol a E E Cl (a € E n ) the 
behavior of the stack of Mi and that of M2 is synchronized. The only difference is 
they piLsh( pop) different symbols. 

When reading a € E^ (a G E r J, for 2 < i < n both Mi and M 2 perform 
Pushi(Popi) and that effect can be simulated by performing a Pushi(Popi) on the 
stack of M. 4 


Note that the construction in the first proof gives a non-deterministic machine 
whereas the second proof helps us to construct a deterministic machine directly if 
both Mi and M 2 are deterministic. This is important because it turns out non- 
deterministic HVPAs is more powerful than deterministic HVPAs (proof is given in 
subsequent section). 
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3.2 Closure under intersection 

Theorem 2 (Closure under intersection) Let L\ and L 2 be higher order vis- 
ibly pushdown languages with respect to E. Then L\ Pi L 2 is higher order visibly 
pushdown language with respect to E. 

Proof: Let Mi = (Q^Qim^ub^QFx) and M 2 = (Q2, Qin 2 , r 2 , d 2 , Qj- 2 ) be HV- 
PAs which accepts L\ and L 2 respectively. 

To accept L\C\L 2 we design a HVPA M = (Q, 6 , Qf) which is almost similar 

to the machine we designed the alternate proof of closure under union except for the 
the set of final states. Q — ^ ^ Qii i 2 j Qf Qf\ ^ Qf 2 j f 1 ~~ Ti ^ f 2* 

Here also M is trying to simulate runs of M\ and M 2 in parallel. M accepts a run 
only if both M\ and M 2 accepts their respective simulated run. i.e if M ends up in 
a state on an input string w, then w is accepted if and only if g* 6 Qf 1 and 

Qj G Q/-v ' 

When reading a 6 E Cl if Mi pushes h and iV/ 2 pushes 70 the M pushes (71,70). 
Similarly the higher order push and pop operations of M x and M 2 can be simulated 
on the stack of M. 

It is is to verify that that L(M) = Li fl L 2 4 


3.3 Closure under renaming 

Theorem 3 ( Closure under renaming) Let L be higher order visibly pushdown 
languages with respect to E and if f is a renaming of E to T! , then f(L) is a higher 
order visibly pushdown language with respect to T! . 

Proof: Let M = (Q,Q in ,T. 5, Q F ) be HVPA accepting L. We design a HVPA 
M' — (Q, Q in , T, 6', Qf) over £ / which accepts f(L). 
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Transform each transition of M on a to a transition on f(a). For example, if 
(<&, a, 7, 9.7, op) € <5, then ((fc,/(a),7, qj,op) G S'. Note that restriction that / maps 
calls of level i to calls level i and returns of level i to returns of level i is necessary 
for HVPLs to be closed under renaming operations. By the definition of S' itself it 
clear that w E L 4$ f(w) E f(L) and hence the theorem. 4k 

3.4 Conversion of HPDA to HVPA under a spe- 
cial mapping on input alphabet 

Theorem 4 Let L' be a level n language (i.e there is a level n HPDA accepts L' ) 
over S'. Then there is a level n higher order visibly pushdown language L over £ 
with £ Ci = E' x {cj} £ ri = £' x {rj and £ int = E' x {intj for 1 < i < n, such 
thatf(L) = l! . 

Proof: Let M' = (Q, Qin, r, S', Qf) be a level n HPDA accepts LI We design 
a HVPA M — (Q, Q in , T, S, Qf) of level n to accept to L. This can be done by 
restricting the transitions according to the input read. For example if we have a 
Pushi from state (p to q.j for M' by reading an alphabet a then M will have transition 
from from state to qj on reading alphabet (a, d) and so on. 

We define the transition relation 6 as follows. Note that S' C (QxExTxQx Op n ) 
where Op n = {pushi} U {push m } U {popk} ) for 2 < m < n, 7 € F, and 1 < k < n. 
If (qi, a , qj, op) G <5 for 7' G T then, 

• Case 1: op = push J for some 7 G T, then (q iy (a, Cn), 7', qj.push}) G 5. 

• Case 2: op = push m for 2 < m < n, then {qi, (a, c m ), y', qj,push m ) G S. 

• Case 3: op = pop k for 1 < k < n, then (q u (a,r fc ),V, qj,pop k ) G S. 
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In our definition of HPDA, every transition changes the stack contents. If we 
allow transitions which does not change the stack contents then they will appear as 
the internal operations in 5 . 

Note that elements of E are pairs. Now we define / to be the projection operation 
which takes elements of E and simply projects the first component of the pair. Now 
we argue that f(L) = L' . 

Suppose w' G I/, then M' has an accepting run on w' . We will create a dec- 
orated string w from w' as follows. Let the transition made on aj(l < i < |a/|) 
be (ft, a, 7, ft, op), then the corresponding letter in w be of the form (a, x) where 
x G {cx, . . . Cn, ri, . . . , r n ,int} and x is determined by what action is done on the 
stack. For example, if the action on ft is Pop m then (a*, r m ) would be the corre- 
sponding letter in w. By definition of 5 , there is a Pop m operation on (a,, r m ). Since 
M' has an accepting run on w', it is obvious that M also has an accepting run w. 

Suppose Let w’ is obtained by taking the first component of letters in w. 

Again by the way 5 defined, for every the transitions in the accepting run of M on 
w, the same operation is possible on M' also, which makes M' to accept w 1 . 4 * 

3.5 HVPLs are not closed under deter minization 

In this section we show that nondeterministic HVPA (NHVPA) is more powerful 
than a deterministic one (DHVPA). In other words, there are languages that can be 
accepted by an NHVPA that cannot be accepted by a DHVPA. 

Consider the following language : 

L = {wiW2Cw-2 R nT[ R da 1 lb 1 ^: n = |kj 2 |, m = |iux| and n,m > 1} where wi,W2 E 
{a,b}*, w 2 r is the reverse of w 2 with a and b replaced by ax and 61 respectively and 
wi R is the reverse of wy with b and a replaced by ay and hi respectively. 
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For example: If to, = abaa and w 2 = bbab then, w\ R = 616,0161 and w 2 R — 

} 

biCii b\b\ . 

The partition on £ is as follows : £ Cl = {a, 6}, £ C2 = {c}, £ n = {a l5 6,}, £ r2 = {d} 
and — (J). 

We design an NHVPA 

^ ( {*70i 7l ) (72) *73 ) <?4 1 75) 76 ) 7acc} > {7o}) {A, A 1 , P, } , {<2, 6, G, , 6, } , ( 5 , {<7acc} ) to 

accept L. In order to make the machine simpler, we add a marker $ ($G E int ) at the 
end of the input. The transitions of M are as follows: 

(go, a, J_) >-► (g 1 /q 2 , Push? ) 

(<7o, b, 1) (qi/q 2 , Push f) 

(q\,a,A/B) (71/72, Push?) 

(q u 6, A/B) (-»• (q l /q 2 , Push?) 

(q-2, a, A/ B I A\l B\) (q 2 , Push? 1 ) 

(q 2 J),A/B/Ai/Bi)>-> (q 2 , Push? 1 ) 

(q 2 . c, A\/ B \ ) i * (<?3i Push 2 ) 

(< 7:1 - fliMi) •-* ( 73 . -P^Pi) 

(q:u b u B x ) •-* Popi) 

( ( l:u <‘\,B) (c/4 , P op I ) 

(c/ 3 , 6,, A) (<74, Popi) 

(q 4 ,ai,B) (</.!, Pop\) 

(q~\, b\, A) i * (c/4. Pop,) 

(g 4 > d, 1 , ‘TV') i-+ (<7 5 , P op 2 ) 

(75,0,, A,) (75, Pop,) 

(75, a,, P,) h-> (<75 , P opi) 

(75,61, A) ^ (7 6 , Popi) 

(75,61, P) (7c, Pop,) 

(< 7 g, 6, , A) (7 (; , Pop,) 

(7 6 ,6i,P) i-> (7,5, Pop,) 

(?6) $1 -L) 1 > (7acc) 
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Intuitively M guesses the split between w\ and w%, and marks it in the stack by. 
using different set of stack alphabets for vj\ and w 2 ( A and B for W\ and A\ and B\ 
for tu 2 ). When M encounters c, the stack is replicated. So while reading W2 R vJ\ R , 

M can verify whether the split made is correct or not by using the top copy of the 
stack. If the split happens to be correct, then M has to verify whether 0^6^ with 
n = |io 2 | and m = holds or not. This can be done using the bottom copy of the 
stack. 

It is easy to see that L(M) = L. 

Now we will prove that L is not accepted by any DHVPA. 

Theorem 5 L (as defined above ) can not be accepted by a DHVPA. 

Proof: The proof is by contradiction. Assume that there is a DHVPA M\ such 
that L(Mi) = L. Let p be the number states of M\. 

Consider an input string w such that |tu| > p + 1 . Observe that the number of 
splits possible on w into W\ and w 2 is |u>| - 1, which is > p. When M\ completes 
reading w\w 2 c, the stack of M\ will have two copies same 1 -store. After reading 
W\W2Cw-2 ii Wi Ii d, the topmost 1 -store would have got popped and M\ will be in 
some state say <j. Note that the split is decided uniquely by the substring w 2 R uii n 
and there can be more than p possible splits. Therefore for some of the splits the 
automaton will have to end up in same state with same stack contents. For example, 

Let U1U2 = viv 2 such that |iq| ^ |tq|, and for both v\u 2 cu2 R u{ R d and ViV 2 cih R TJi R d, 

M 1 ends up in the same state, say q. Since both uiU 2 cu 2 H Ui R da^bi l ' \ and viihci^v^da^b^’' 
are in L, M\ can reach an accepting state from q on both Oj U 2 'i>j Ul ' and This 

would make M\ to accept UiU2CU2 R ui R da\^b^ V2 \ a string which is obviously not 
in L. So we arrive at a contradiction to the assumption that L(Mi)=L. 4 

So we have got a language L accepted by NHVPA and not by any DHVP, which 
proves the following theorem. 

Theorem 6 HVPLs are not closed under determinization. 
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It is interesting to observe that even though L is not determizable, it can be 
complemented. That is, we can design 2-level HVPA to accept L. There are 3 cases 
which makes a string vu to be in L. 

• Case 1: w is ill formed, i.e either w is not in the form ucvda x b™ with u € {a, b}* 
and v € {ai, b x }* or even if w = ucvda™b™, the sizes of the substrings do not agree. 
That is, either \u\ ^ n| or \u\ ^ n + m. 

• Case 2: w is in the correct format but there are no w x and u >2 such that w is 
of the form w x w 2 cw 2 R W\ R daib 

• Case 3: w is of the form w l w 2 cw 2 R W x t da r {W[ l , with n ^ \w 2 \. 

Designing deterministic HVPAs to check whether w satisfies case 1 or case 2 is 
easy. Let M x and M 2 be HVPAs which checks conditions 1 and 2 respectively. 
For case 3, we can design a non-deterministic M 3 machine similar to one which we 
designed to accept L. The only difference M x has with M is that, when M x detects 
that the number of ai’s is not equal to |u> 2 |, then M x should indicate it by going to 
an accepting state and staying there till the entire input has been read. 

If a string w € L, then it comes from on of the above three cases. So L{M X ) U 
L(M 2 ) U L(M 3 ) = L is trivial. Now we design an HVPA M' which accept L(M X ) U 
L(M 2 ) U L(M 3 ). 

3.6 Some interesting level — 2 HVPLs 

L x and L 2 over E under the partition E Cl = {a, 6},E C2 = {c},E n = {a x ,b x }, 
E r2 = {d} and E int = are defined as follows: 

L x = {w x xw 2 c w% etR w x netR d a)™ 2 * } 

L 2 = {w x xw 2 c W 2 etR w x netR d a'^ 2 ' } 
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where wi,W2,x € {a, b, a x , bi}*, W2 netR (w 1 netR ) is the “net reverse” of u>2 {w\) 
with a and b replaced by Oi and b\ respectively, vJ\ netR is the “net reverse” of Wi 
with a and b replaced by &i and a\ respectively, x is a string whose no prefix has 
more number of return symbols than call symbols and the stack content is the same 
before and after reading x. “net reverse” of a string is the reverse of the subsequence 
of unreturned calls. For example, if w\ = abbaaibybab u then the subsequence of 
unreturned calls is, abb. Then wi netR is bibiai and w\ netR is 

Observation 1 L\ is accepted by DHVPA. 

In a first look it may appear that the split into w\, x and W2 is important. But if 
we observe a bit closer it becomes clear that the split is not important. Because in 
whichever split we take the stack content after reading w\xw 2 would be the same. 
So matching of w ™ etR Wl netJi becomes easy. In other words L\ and the following 
language are one and the same. 

Lz = {w c w netR d a^b™ : |m| = n + m} 

Observation 2 L 2 is accepted by NHVPA but not by DHVPA. 

By using similar arguments we used to show that L(as defined in the proof to 
show that HVPLs are not determinizable) is not determizable, we can show that L 2 
is also not determinizable. In case of L 2 also we can design an NHVPA such that 
if a string is in the language, then there is unique accepting run. Again by similar 
techniques we used to complement L, we can complement £2 also. 

We give a HVPL L 4 , whose complement £4 is believed not to be an HVPL. £4 
over £ under the partition E Cl = {a, b},E C2 — {c},£ n = {ai,b x }, E r2 = {d} and 
Smt = (j> is defined as follows: 

£4 = {1V1XW2 c w R yw i R d aiX R b™ : n = |-tu 2 | , m = |wi|and |x| = |y|} 
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where wi,w 2) x € {a, b}*, w 2 R is the reverse of W2 with a and b replaced by Ox 
and bi respectively and W[ R is the reverse of w 4 with b and a replaced by ax and bi 
respectively, y £ {ax, £>1}*, x R is the reverse of x with b and a replaced by ax and 61 
respectively. 

Observation 3 L 4 is accepted by NHVPA but not by DHVPA. 

We design a non-deterministic HVPA, M 4 that accepts L 4 . Intuitively M 4 guesses 
the splits wi, x and w 2 and marks them on the stack using different set of stack 
alphabets and while reading w R yw\ R d dfx R b™, M 4 can verify whether the guessed 
split was correct or not. M 4 accepts the input string if the guess was correct. We 
use A and B for wi, A x and B x for x and Ai and B x for w 2 as the stack alphabets. 
In order to make the machine simpler, we add a marker $ ($e £ int ) at the end of 
the input. M 4 is defined formally as follows: 


({9o - • • 9io> Qacc } > {90}) {A, B , A x , B x , A\ , -Bi} , {a, b, a 4 , ^i}, b, {gacc}' ) 


The transitions of M 4 are as follows: 

(96, a, L/A/B) 1 1 (90/91/92, Pushf ) 
(9o, b , 1 /A/B) (50/91/92, Pushf) 

(91, a, A/B/A x /B x ) *-> (51/92, Pushf x ) 
(qi,b,A/B/A x /B x ) (qi/q 2 , Pushf x ) 

(92, a, , A/B/A x /B x ) ►-> (53, Pushf 1 ) 
(92, b, A/B/A x /B x ) t-> (53, Pushf 1 ) 

(93, a , A\/ B\) (g 3 , Pushf 1 ) 

(93, b, A1/B1) ^ (q 3) Pushf 1 ) 

(94, c, Ai/ Bi) (q 5 , Push 2 ) 

(95,^1, Ax) (qs,Popi) 

(95, b\, Bi) (95,-Papi) 

(95, ax, 4*/ Bx) »-♦ (9e, Bopx) 

(95, bi, A x /B x ) (g 6 , Popi) 

(96, ai, A x /B x ) (9 6 ,Popx) 
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(q & ,b u A x /B x ) (q 6 ,Popi) 

(96, ai, Bi) ■-+ (q 7 ,Popi) 

(<?6, Ai) »-> (q 7 , Popi ) 

(97,ai,i?i) ■-+ {4r,Popi) 

{<fr,bi,Ai) *-*■ (57, P op\) 

(Qt , d, -L, ‘IV') h-> ( q 8 ,Pop 2 ) 

(g 8 ,ai, Ai) <-+ (q 8 ,Popi) 

(qs,a u Bi) !-»• ( q^Popx ) 

( 9 s, ai, 5 X ) hh- (59, PopO 
(<?8,6l, A x ) *-* ( 99 ,-Popi) 

(q 9 ,<ii,P x ) i (59, Popi) 

(99)6i,A x ) »— » (q$,Popi) 

(59, b\,A/ B ) ► (510, Popi) 

(gio,^, A/P) • ^ (510, Popx) 

(5l0, S, -L) I— > (<?acc) 

Now we will give some intuitions for why L 4 does not seem to be a HVPL. Unlike 
from the other languages given above it seems that no HVPA can be defined such 
that the accepting run of an input string is unique. In other languages it was 
easy because the split in to W\ and w 2 was uniquely determined by the substring 
between c and d. But in case of L 4 the split is determined by the substring after d. 
Moreover in case of other languages there was a unique accepting run for strings in 
the language. But in case of L 4 the number of accepting runs is unbounded. That 
means, for large enough strings there can be many accepting runs and the number 
accepting runs can not bounded by any number. So in order to accept L4, a HVPA 
should be able to decide whether a given string is not accepted in any of its runs, 
which seems to be an impossible task. Unfortunately we do not have a formal proof 
for that. 
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3.7 HVPLs are not closed under Concatenation 


and Kleene * 

It turns out that HVPLs are not closed under concatenation. In order to show an 
HVPL, L is closed are closed under concatenation , we should be able to simulate 
two strings in L without mixing up the stacks of different simulation. The example 
given below shows that it is impossible to have a such a simulation without mixing 
up of stacks. 

Theorem 7 HVPLs are not closed under concatenation. 

Proof: We give an HVPL, L and show that L.L is not HVPL. L is defined as 
follows: 

L = {a ll b m : n > m,n > 0 } over £ with partion : £ Cl = <p, £ C2 = {a}, E ri = 
<f>, £ r2 = {&} and S tnt = ■ 

It is easy to see that the HVPA given below accepts L. 


^ ( { Qo , Qacc , Qrcj } - {}j i l^acc}) 

) 

The transitions of M‘ are as follows: 

(Qo, o, 1) f* ( q acc , Push 2 ) 

{q acc , a, JL) (q acc , Push 2 ) 

(qacc, b, ±S N') ^ ( q acc , Pop 2 ) 

(Qacc, b, _L, y ) i ■> (q r ej) 

Now we will prove that no HVPA accepts L.L. Proof is again by contradiction. 

Assume that there is an HVPA M such that L(M) = L.L. Let p be the number 
states of M. Consider an input string w = a n b n such that n > p. While reading 6’s, 
since n > p some of the states of M should repeat. Let q be one of the repeated 
state in the simulation of w = a n b n . Let the number of stacks popped between two 
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y’s be k. That means in an accepting run the state q is repeated and in between the 
repetition we could pop k number of stacks. So we can repeat the moves from q to q 
by popping k more stacks and still end up in an accepting state. Now consider the 
run of M on the input string a^ +k ' > b\a n b n+k . After reading a^^b 1 , the stack of M 
will have k empty 1- store. This makes M to accept cb l+A V ,a n b n+k because we could 
have repeated the moves between two q’s by popping k more stacks and still ending 
up in a final state. Since a^+^b 1 .a n b n+k is not in L.L. we arrive at a contradiction 
to the assumption that M accepts L.L. 4k 

Theorem 8 HVPLs are not closed under Klccne *. 

Proof: Consider the language L defined in the proof of the above theorem. We 
show that no HVPA accepts L* . Note that L* := L° U L 1 U . . .. 

Assume that there is an HVPA M such that L(M) = L* . Since M accepts L*, it 
should accept all strings in L 2 . Then using the same arguments we used in the proof 
of the above theorem we can show that M accepts strings of the form a^ lJrk) b l .a n b n+k 
which are obviously not in Lr. Moreover it is easy to see that strings of the form 
<k ,Jrk U)' .a ’'b n+k does not belong to any L?,j ^ 2. So we arrive at contradiction to- 
the assumption that L(M) = L * . 4k 

3.8 Difficulties faced in giving a logical character- 
ization for HVPLs 

In [1] a logical characterization for VPLs was given in terms of Monadic second 
order logic (M SO tl ). Fix E. A word w over 2 can be treated as a structure over 
the universe U = l,...,|ie| that denotes the set of positions and a set of unary 
predicates Q a , for each a E E, where Q a (i) is true iff m[z] = a. The “match” relation 
of calls and returns /i over U is defined as follows : is true iff w[i] is a call 

and w[j] is the matching return. Let x,y,... denote the first-order variables and 
X , Y, . . . denote the second-order (set) variables. The M SO^ over E was defined as : 
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(f) = Q a (x) | x G X | x < y | y(x, y ) \ ->0| <f) V <f> | 3 x.<f> | 3X.(f) 
where a G E, x is a first-order variable and X is a set variable. 

Note that in case of VPLs, there is an inherent matching in the run of a VPA 
on a word w. i.e For any a G E c that appears in w, either it is a unreturned call 
or the symbol pushed by the VPA while reading a will be popped by some b G E r . 
This way we can associate every call(except for unreturned calls) with exactly one 
return that appears in later part of w. But such a matching is not so clear in case 
of HVPAs, because we could pop an entire stack by a higher order pop operation. 
So definition of the “match” relation y became a tough task. 

One possible way of defining the “match” relation for an n-level- HVPA could be 
defining a set of predicates ya-s, 1 < i < n in the following manner. Let w be a word 
over S. yi (i,j) = true if w[i\ € E Cl , w[j] & E n and when reading w[j], the symbol 
popped is the symbol pushed when w[i] was read. Note that y\ can be a many-one 
relation because of the stack replication. That is, the symbol pushed by tu[i] € E C1 
could be popped by many w[j]'s <G E ri if the stack after reading w[i] was replicated. 

= true , for i > 1 if m[i] G E Ci , w[j] G E r . and when reading w[j], the stack 
popped is the stack replicated when w[i] was read. 

We believe that it could be possible that the runs of HVPAs can be characterized 
by the boolean closure of the set of logical relations y\s. In order to make things 
clear further investigation has to be done. 
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Chapter 4 

Higher order Visibly Pushdown 
^-Languages 


In early sixties, Richard Buchi introduced the concept of finite automata on infi- 
nite words in [10]. Working on weak theories of integers, he was lead to consider the 
monadic second order theory of the successor function on integers. He was able to 
prove the decidability of this theory. Later on, in [11] Robert McNauhton proved the 
equivalence of deterministic and non-deterministic automata, a natural extension of 
the corresponding result for finite words. This difficult result was conjectured by 
David Muller while working at questions related to oscillating circuits. The notion 
of an infinite sequence is of interest to model the behavior of systems which are 
supposed to work endless, as operating systems for example. 

In this section we introduce HVPA on infinite words w-HVPA and shows they are 
closed under union, intersection and renaming. We also show that non-deterministic 
Buchi and Muller cj-HVPA can simulate each other. 

Definition(Higher order Visibly Pushdown u- Automata) An u-HVPA is 
a tuple M — ( Q , Q in , T, 5, F) where Q, Qi n , T and 6 are same as that in HVPA and 
F is the “acceptance component” of the u-HVPA. 


j 
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For any a G S“, a run is a sequence p = (<?o> &o), (< 32 , cr 2 ) ... is a natural extension 
of the definition of run over finite words. Contrary to HVPA on finite machines, 
w-HVPA runs for ever. While the acceptance condition of automata on finite words 
is rather canonical, there are many possibilities of defining acceptance on infinite 
words. An acceptance condition restricts the occurrence of states in a run p under 
consideration. 

We define inf(p) C Q as follows: 

we write 3° for the quantifier “there exists infinitely many” , then 

inf(p) = q £ Q : 3 u i p(i) — q which is the set of all states that occur in p infinitely 
often. 

There axe two widely used acceptance conditions namely Buchi and Muller accep- 
tance conditions: 

* Buchi acceptance condition : F = F C Q is a set of states; a run p is accepting 
if F is met infinitely often along the run. i.e inf(p) ^ <p. 

* Muller acceptance condition : F = F = {iq, . . . , F k } where each Fi C Q-, a run 
p is accepting if the set of states it meets infinitely often is an element of F. i.e 
inf(p) € F. 

An infinite word a is accepted by M if there is some accepting run of M on a. 
The language of M, L U (M), is the set of all u;- words that it accepts. A language of 
infinite words L C is said to be an ai-HVPL if there is some cj-HVPA M such 
that L = L U (M). 
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4.1 Equivalence of Non deterministic Buchi and 
Muller oj- HVPAs 

Theorem 9 Non deterministic Buchi and Muller uj-HVPA can simulate each other. 

Proof : In [12] it is shown that in case of finite automata the above theorem 
holds. We also adopt a similar proof. 

A Buchi w-HVPA can easily be simulated by a Muller o;-HVPA, by collecting, 
in its acceptance component F, those states which lead to acceptance in the given 
Buchi w-HVPA. 

In turn given a Muller w-HVPA with acceptance component F, a corresponding 
Buchi oHVPA guesses in advance the set F € F of states to be visited infinitely 
often, and also guesses the point on its input a from which onwards only states in F 
will be seen. From there onwards it suffices to check that the visited states fill the 
set F again and again. This can be signaled by the Buchi acceptance condition. 4k 

4.2 Closure properties of cj-HVPLs 

By using similar techniques we used for HVPLs the last section, it is easy to see 
that the following theorem holds. Note that the notion of renaming can be extended 
to infinite words in a natural way as follows : 

/(aia 2 ...) = /(ai)/(a 2 )... 

Theorem 10 (Closure) Let L\ and L 2 be higher order u -visibly pushdown lan- 
guages with respect to E. Then L\ U L 2 and L\ n L 2 are higher order u-visibly 
pushdown languages with respect to E. If f is a renaming of E to T! , the f(L) is 
higher order uj-visibly pushdown language with respect to T ,' . 
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4.3 Deterministic Vs Non-Deterministic o;-HVPLs 


Theorem 11 (Deterministic Vs Non-Deterministic u-HVPLs) u-HVPL 
are not determinizable. 

Proof: Consider the following language L rep tad : 

Lrepbdd consists of all words a G {c, r} w , (where c is a call and and r is a return), 
that is repeatedly bounded- i.e. a G Lrepbdd if there is some n G N such that the 
stack depth on reading a infinitely often is is less than or equal to n. This kind of 
acceptance condition was first considered in [13]. 

In [1] it has been showed that L rep bdd can be accepted by a 1 — level non- 
deterministic Buchi oVPA and can not be accepted by any 1 — level deterministic 
Muller w-VPA. 4 
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Chapter 5 

Conclusion and future work 


In this work we have defined HVPAs, and the closure properties of the languages 
accepted by them are studied. We also have shown the equivalence Buchi and 
Muller acceptance conditions for cj-HVPLs . We strongly believe that HVPLs are 
not complementable, but a formal proof is yet to be obtained. In [ 1 ] it is has been 
proved that even though cu-VPLs are not determinizable, they are complementable. 
But it is not known that whether cu-HVPLs are complementable or not. We expect 
that there is room for further research in this direction. 

Another direction that can be explored would be studying about the decision 
procedures and its complexity for HVPLs. In [14] it has been shown that the the 
emptiness problem for HPDAs ( both deterministic and non-deterministic) are non- 
elementary complete. Since HVPAs are a restrictive version of ordinary HPDAs, it 
would be interesting to investigate for a procedure of elementary complexity. 

Recently in [5] games on VPAs are defined and its properties have been studied. 
They have established that, unlike pushdown games with pushdown winning condi- 
tions, visibly pushdown games are decidable and are 2 -EXPTIME-complete. Since 
HVPLs are closed under intersection, one may explore this direction by looking at 
the games defined on HVPAs and try to see for what kind of winning conditions 
they are decidable. In [5] it has been further proved that the topological complexity 
of visibly pushdown languages is a subclass of boolean combinations of S 3 sets. It 
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would be interesting to see the topological complexity of HVPLs and position of it 
in the Borel Hierarchy. 

For the research community it has a been a greater interest to establish the the 
relation between various kinds of automata and the grammar counter part of it. 
Grammar characterizations for higher order PDA axe given in [7] and [8] and known 
as indexed grammars. One may try to see the characterization of HVPLs in terms 
of the grammar. 

A lot of variations of different kinds of automata, and their power in terms of com- 
putation also been studied for a long time. Alternating automata, Tree automata, 
Automata acting on trees, Infinite automata, Automata on infinite objects etc axe 
some of the mostly investigated ones. But from the literature it seems that not much 
research has been done with higher order pushdown automata in this direction. 
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